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Abstract 

In the formation control problem for autonomous robots a distributed control law steers the robots to 
the desired target formation. A local stability result of the target formation can be derived by methods of 
linearization and center manifold theory or via a Lyapunov-based approach. It is well known that there 
are various other undesired invariant sets of the robots' closed-loop dynamics. This paper addresses a 
global stability analysis by a differential geometric approach considering invariant manifolds and their 
local stability properties. The theoretical results are then applied to the well-known example of a cyclic 
triangular formation and result in instability of all invariant sets other than the target formation. 

I. Introduction 

The formation control of a network of autonomous mobile robots is an interesting instance 
of distributed control and motion coordination. In this setup the autonomous robots have to be 
stabilized to a formation while each robot has only locally sensed information about the others. 

In the formation control problem graph theory plays a natural role, both to define a formation 
and to describe the sensor relationships-who can "see" whom. Early work used the graph- 
theoretic concept of rigidity to construct undirected graphs [[T|, [|2| suited for formation control. 
These concepts have been extended to directed graphs in [|3|. An excellent reference reviewing 
the application of rigidity theory in formation control is |'4'|. Recently rigidity was employed as 
an analysis tool to show the stability of the desired target formation which is specified as an 
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infinitesimally rigid framework Typically, a potential function approach is used to design 

distributed control laws, an approach that originally emerged for undirected graphs f2l but has 
recently been extended to directed topologies [|5|, [[6). In a potential function approach a natural 
Lyapunov function candidate is readily available and leads to an exponential stability result with 
a guaranteed region of attraction depending on the rigidity of the formation [j6J. Local stability of 
the target formation can also be shown via methods of linearization and center manifold theory 
||5|, an approach that is also inherently related to rigidity. Neither of these approaches leads to 
global stability results since it is well known that there are various invariant sets of the robots' 
dynamics other than the target formation. A global stability analysis considering these sets has 
been carried out only for the benchmark example of a triangular formation [|7|-[ 1 1 1 yielding 
convergence to the target formation from all but initially coUinear formations. 



In the global stability analysis each of the references [|7|-pT| follows a Lyapunov-type 
approach specific to the triangular formation which is not extendable to higher order formations. 
The present paper provides a tool independent of a Lyapunov function and based on differential 
geometry in order to rule out convergence of the robots to undesired equilibrium sets. These 
sets are parametrized as submanifolds embedded in the space of inter-agent positions, where the 
formation dynamics naturally evolve. A differential geometric stability tool for submanifolds is 
derived based on showing that the linearized vector field points away from these manifolds. This 
geometric result is based on purely algebraic computations and suffices to show instability of 
these submanifolds without guessing a Lyapunov function. In the application of this geometric 
method to the benchmark example of the triangular formation (with a cyclic sensor graph) we 
can confirm the results of [|7|-pT|: initially non-coUinear robots will be strictly bounded away 
from the set of coUinear formations and converge exponentially to the desired target formation. 

This paper is organized as follows: Section |ll] recalls the formation control problem for three 



robots. In Section III the geometric method is derived and applied to the triangular formation in 



Section |IV] yielding a global stability result. Finally, some conclusions are drawn in Section |Vj 

II. The Formation Control Problem for Three Robots 
A. Review of the Setup 

For our purposes an autonomous robot is a fully actuated vehicle in the plane that has no 
communication devices and is equipped only with an onboard camera. We assume that the robot's 



motion is modelled by the dynamics Zi = Ui, where Zi E is the position of robot i and Ui E 
is the control input. Altogether we consider three such robots and with the concatenated vector^ 
z = {zi,Z2, Z3) and u = {ui,U2, U3) in the overall dynamics are i = m. 

The sensing topology among the robots is specified by the cyclic sensor graph Q, a directed 
graph with three nodes and three edges with clockwise orientation, as illustrated in Figure [T| The 
nodes of Q correspond to the robots, and we embed the graph into the plane as the framework 
(Q, z). An edge k from robot i to robot j corresponds to the link = Zj — Zi eM? and means 
that robot i can sense the relative distance and direction of robot j via its onboard camera. 

We use the notation e = (ei, 62, 63) E for the concatenated vector of links, I2 for the 2x2 
identity matrix, and O2 for the 2x2 zero matrix. With the block circulant incidence matrix 
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the links are obtained as e = if z. The links are not independent, but subject to the constraint 

61 + 62 + 63 = 0, (1) 

where G is the vector of zero entries. The constraint ([T]) corresponds to the cycle (1, 2, 3) 
in the graph Q and defines a subspace in with normal vectors spanned by the columns of 
(/2, 12, h)- We refer to this subspace as the link space and denote it by hnH (image of H). 

Given the sensor graph Q, a triangular formation is specified by a set of distance constraints 
dk > 0, k E {1,2,3}, such that ||efc|| = dk. Of course, the distance constraints have to be 
realizable, that is, fulfill the triangle inequalities. The goal in formation control is to find a 
distributed control law Ui = Ui{ei), that is, each control law can be implemented by onboard 

'Vectors are written either as n-tuples or column vectors. 




Fig. 1. Illustration of the framework {G,z) together with the links e 



sensing, such that z{t) converges as t — )• oo and Unit ||efc(t)|| = dk for all k. We refer to the set 
of all frameworks {G,z) fulfilling the distance constraints as the target formation. 

In general, conditions to guarantee cohesion of the target formation and to stabilize the robots 
to it require a property called rigidity of the target formation. Rigidity boils down to a rank 
condition on the rigidity matrix Rg{e) = diag (cj)^ -ff: if the ranking (e) = 3 (it can't be more) 
then the formation {G,e) is said to be infinitesimally rigid. Infinitesimal rigidity is a generic 
property that holds in an open and dense set. In the triangular example all but coUinear (and 
collocated) formations of robots are infinitesimally rigid and the additional necessary property 
of constraint consistence [[3| is also fulfilled. We do not further dwell on these properties but 
refer to [|4| reviewing rigidity theory and to [[5|, [[6| relating it to sufficient stability conditions. 

Ideally the robots should converge to the target formation from any starting point. It is known 
that this goal cannot be achieved for every initial position z{jd), for example, the references [|5|, 
[|7|-pT| show that three initially coUinear robots cannot form a triangle. The objective of the 
present article is to provide a tool to find the exact region of attraction for the target formation. 



B. A Potential Function Based Control Law 

Typically a potential function approach is used to derive a distributed control law to tackle 
the formation control problem. For each robot a potential function is constructed that is zero 
whenever the robot has the desired distance from its neighbour and is positive when the distance 
constraints are violated. For robot i define Wi : — )■ M as Wi{z) = | (||ej||^ — df^. In order 
to minimize its potential, robot i descends the gradient of the potential function, that is, Uj = 
— [d/dziWi{z)]^ . For notational convenience, we introduce the vector ip = (t/^i, ?/'2, V^s 



where -ipi 



df. The overall closed-loop 5;-dynamics are then 
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Different approaches analyzing the ^-dynamics in the state space have been proposed f2}\, 
||5|. The target formation set in M?, i.e., the triangle, is invariant under rigid body motion. When 
lifted up to M^, the home of z, this set is non-compact. This complicates an analysis based on 
differential geometry, set stability or invariance concepts. In addition, the formation specification 



is in the link space. Fortunately, the target formation parametrized in the link space, 

Se = {ee ImH : ||efc|| = dk,k = {1,2,3}}, 

is compact. For these obvious reasons we approach the stability analysis of the target formation 
in the link space. The closed-loop link dynamics resulting from the ^-dynamics are 
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The flow of the link dynamics in the link space Imff will be denoted by ^(t, eo). 



C. A Preliminary Stability Result of the Target Formation 

An intriguing approach to prove stability of is to use the somewhat natural set-Lyapunov 
function candidate V : ImH M. defined as the sum of the potential functions 

The derivative of V{e) along trajectories of the link dynamics can be compactly formulated as 
dV 

—e = - Weiipi - e2tp2f - \\e2^p2 - esip^f - We^ips - eiipif = -ilF Rg{e) Rg{e)^ ijj , (4) 
oe 

where Rg{e) is the rigidity matrix. With the notation f2(c) = {e E ImH : V{e) < c} for a 
sublevel set of V{e) the following theorem can easily be derived from (|4]): 

Theorem 2.1: ^ Theorem 5.1] For every initial condition eo G Imi^ the link dynamics ([3]) 
are forward complete and bounded in the compact sublevel set il(y{eo)), and their solution 
eo) converges to the largest invariant set contained in 

We = {een{V{eo)) : Rg{e) Rg{ef ^ = 0} . 

Moreover, given p > such that for every e E ^l{p) the formation (Q, e) is infinitesimally rigid, 
for every initial condition eo G f2(p) the set £e is exponentially stable. 



By Theorem 2.1 the link dynamics converge either to the target formation £e or the set yVe\£e, 
that is, the set of points in We where the matrix Rg{eY has a rank loss, spoken differently the 
set of non-rigid (i.e., coUinear) formations. Locally the robots converge to the specified triangular 
formation with VL{p) as guaranteed region of attraction. Note that fi(p) is not necessarily a small 



set since rigidity is a generic property. As a result of the exponential convergence rate, the right- 
hand side of the z-dynamics (|2]) can be upper-bounded by exponentially decreasing signals and 
thus the positions also converge. Therefore, locally for every initial condition zq G (^(p)) 
the convergence of the robots to the formation is provable in straightforward fashion [[6|. 



Theorem 2.1 has a game-theoretic interpretation and also extends to a wider variety of graphs 
including undirected minimally rigid graphs [6|: for these graphs the only possible positive limit 
sets are the (locally stable) target formation and non-rigid formations. However, this result is 
only local and we are interested in the global behavior of the robots in the link space. Thus 
we have to find out the stability properties of the non-rigid sets. Such a global analysis for the 
triangular benchmark problem has been undertaken in [|7|-[|9| and for slightly different graphs in 



T0|, [11 1 using problem-specific Lyapunov approaches. The next section provides a geometric 



method that allows an alternative approach by analyzing the linearized link dynamics only. 

in. A Manifold Instability Theorem 

The limit set We of the link dynamics can be split into the target formation £e and the set 
We \ £e of non-rigid limit sets. In order to show that We \ £e is not a positive limit set, it has 
to be shown that the vector field, the right-hand side of the link dynamics ([3]), is pointing away 
from We \ £e- This section formulates this idea in terms of differential geometry. 



A. The Notion of Overflowing Invariance 
Consider the dynamical system 

X = f{x) , x{0) =xoEMJ', (5) 

where / : M" — )■ M" is a twice continuously differentiable vector field generating the flow 
^{t,x). In what follows, fxip) will denote the Jacobian of f(x) at x = p. Let Ai be an m- 
dimensional differentiable submanifold embedded in M" that is invariant w.r.t. ([5]), that is, 
for every xq E Ai, ^{t, Xq) E Ai for all t > 0. The normal and tangent space at p G are 
denoted as NpA4 and Tp Ai, and the normal and tangent bundles as NAi and TAi. Geometrically 
speaking the invariance of Ai with respect to (|5]) is equivalent to f{p) E Tp Ai for all p G A^. 

The specification of Ai as an embedded submanifold allows us to identify a normal direction 
relative to Ai. Given an e > 0, we can always construct a neighbourhood of Ai consisting of 



points p G that are not further than e away from Ai [12, Theorem 6.17]. This can be seen as 
an embedding of the normal bundle NAi into M" and we define the tubular e neighbourhood 

Me := {p : p = p + enp,p E M,np E NpM, \\np\\ = l,e G (0,e)} . 

We denote the boundary of the tubular e neighbourhood Aie by dAie' 

dMe := {p eW : p = p + enp,p E M,npE NpM, \\np\\ = 1} . 

Let Aie := AiU AifU dAie be the closure of A^^- Next we define the orientation of the vector 
field / on dAie- Consider an e > 0, a point p E Ai, and a normal vector Up E NpAi of unit 
length. From this we construct the point p E dAie as p = p + eup. The inner product of the 
vector field f{p) and the normal vector Up is then 

(/ iP) , np) = {f{p + enp) , Hp) . (6) 

If the inner product (|6]) is positive, then the vector field and the normal vector point in the same 
half space. We then say the vector field f{p) is pointing strictly outward aX p E dAie- Note that 
this property depends on /, e, p, and Up. Consider a set n with Ai D^l ^ If there exists an 
e > 0, such that for every p E Ai D^l and for every Up E NpAi with \\np\\ = 1 the vector field 
is pointing strictly outward, then we say Aie is overflowing invariant in ^l. 

Remark 3.1: The term overflowing invariance is taken from Fenichel Theory, which treats 
the stability properties of differentiable manifolds with boundaries jTSl. The invariant manifolds 
arising in our problem setup have no boundaries and thus this theory is not directly applicable. 



B. A Manifold Instability Result 

The definition of overflowing invariance does not provide an easily checkable condition, since 
it depends on the, possibly nonlinear, vector field / and the variables e > p E Ai, and Up E 
NpAi- Note that every embedded submanifold may be parameterized locally by the zero set 
of a smooth function [[T2| Proposition 5.28]. In particular, consider the global case, where a 
continuously differentiable function F : M" — M"^™ defines the zero set := F^^(O). If 
rankFj.(p) = n — m for all p G A^, then Ai is an m-dimensional embedded submanifold, F is 
said to be its global defining function, and the columns of the Jacobian Fx{pY are a basis for 



NpAi [12 Corollary 5.24, Lemma 5.29]. In this case, the idea to derive a checkable algebraic 



condition of overflowing invariance is to contract the tubular e neighbourhood of to a thin 
layer, in fact, to such a thin layer that the Taylor linearization of the vector field is valid. 

Theorem 3.1: Consider the vector field / and an invariant embedded submanifold Ai : = 
F~^(0) with the global defining function F : M" — M"^*". Let ^7 be a compact set with 
compact and non-empty intersection Ai HQ, and consider for every p E Ai H the matrix 



r(p) = F,{p) [Up) + Upf)F,{pf e m(--)x(— ) . (v) 

Assume that T{p) is positive definite for every p E Ai nVl. Then there exists e* > such that, 
for every e E (0, e*], the tubular e neighbourhood Aie is overflowing invariant in ^l. 

Proof: Let e > be arbitrary. We look at a point p E dAi^. By definition, it has the form 
p = p + eup for some p E Ai and Up E NpAi with \\np\\ = 1. With NpAi = ImF^(p)-^, Up can 
be parametrized as Up = F^.(p)^c, where c E M"^™. The inner product of / (p) and Up is then 

(/ (P) , rip) = {fip + erip) , rip) = {f {p + e F,{pfc) , F^ipfc) . 

The ingredients A^, A^^, and / are illustrated in Figure |2] together with a trajectory. We now 
expand f [p + eFx{p)^c) in a Taylor series about p E Ai and obtain for the inner product 

(/ (p) , np) = {f{p),np) + {ef^{p)np , n,) + {R^ {p, e) , Up) , (8) 

where R3 {p, e) is the Lagrange remainder of the Taylor series expansion and is of second order in 



e [ 14 Theorem 4.1]. Note that the first term of ^ vanishes because E NpAi and f{p) E Tp Ai 
due to invariance of the manifold Ai. Thus equation ([8]) simplifies to 



(/ (p) ,np) = - c^r(p)c + (i?3 {p, e) , Up) 



VI 1 



(9) 



where r(p) is defined in (|7]). By definition Ai^ is overflowing invariant in if the inner product 
(|9]) is positive for every p G AI fl fi. If the symmetric matrix r(p) is positive definite, it is clear 
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Fig. 2. Qualitative illustration of A4, A4t, /, and a trajectory ^{t,xo) with xo G M^. 



that we can obtain a positive inner product at every point p E Ainilhy choosing e sufficiently 
small at p. Let e be such a sufficiently small e at p e M nVl. Then we have 

{\fpeMnn)i3~e>0) ^c^T{p)c>^\{Rs{p,i),np)\ . 

The right-hand side of the previous equation is upper bounded by the maximum Lagrange 
remainder, and by assumption, we have that T(p) is positive definite for every p E Ai D^l: 

{'ipEMnn){3T* >0, R* >0) T{p)-^Ir^-m>0 , iR* >l^\{R3{p,i),np)\ . (10) 

To overcome the obstacle that both T* and R* are dependent on the point p, we appeal to 
compactness. Due to the Heine-Borel Theorem [15, Theorem 3-40] we can cover the compact 
set n by a finite number k of closed balls Bi, where i E {I, . . . , k}. Since fxip) and Fx{p) 
are continuous, T{p) is a continuous function of p. Thus on each of these balls T* and R* attain 
their minima and maxima as T* := minpge.nxnn T* and R* := maXpge-nxriQ R*, where T* and 
R* depend on Bif] Ai n^l. We define e* > such that the following inequality holds: 

{WpEBinMnQ) Jc^r*c > e* r* . 



Therefore, we obtain together with ( [T0| ) that 



1 . 1 



(3e* >0)(VpGi3,^^^^^]) ^c^r(p)c> ^ |(i?3 (p,e*) . 
Because the number of balls is finite, we define e* > as e* := minj=i ^ e* and have the result 

(3e* >0)(Vpe A^nr]) \c^V{py > i|(i?3(p,e*)),np|. 

Thus e* provides a uniform bound for which the inner product ([9]) is positive for every p E AinVl. 
Clearly, the inner product is then also positive for every j9 G if we choose any e E (0, e*]. 

In other words, for any e E (0, e*], Aii is overflowing invariant in ■ 



Theorem 3.1 provides a checkable condition on the overflowing invariance of Ai within the 
compact set f2. Under further conditions on ^l, hyperbolic instability of AiDVl can be established. 



Corollary 3.1: Under the assumptions of Theorem 3.1 and the additional assumption that Vt 
is an invariant strict superset oi AinVt, for any e E (0, e*] the set Vt \ Ai^ is invariant. 

Proof: The set Q can be partitioned by the non-empty sets Ai^ C] Q and Q \ Ad^. Let 
us establish a correspondence of overflowing invariance and the flow of the vector field: since 
Ai^ is overflowing invariant in ^l, we have for every xq E dAi^ fl f2 and for all t > that 



Xo) ^ Aie n ^l. Therefore, a trajectory starting off Aie fl is bounded away from the 
partition Ai^D^l. Invariance of i7 \ follows then immediately from the invariance of fi. ■ 



Corollary 3.1 allows a straightforward instability check of the set AiD^l, simply by analyzing 
the linearized vector field in (|7]). In the case that Ai is the origin and is some nontrivial 
set containing Ai, equation Q reduces to the equation obtained by Lyapunov's first method 
when using the identity as the Lyapunov matrix. Note that the results of this section can also 
be reversed, leading to asymptotic stability of a manifold p^. In the following section the 



geometric method will be applied to the link dynamics to show instability of the set We \ £e- 

IV. Global Stability Analysis of the Target Formation 

A. Equilibria and Invariant Sets of the Link Dynamics 

The limit set of the link dynamics We can from Q be parametrized as We = {e G \m.H : 
eiV^i = e2il>2 = 637/^3}, which is the set of equilibria of the link dynamics ([3]). Clearly, We 
contains besides the target formation Se also the set of coUinear (non-rigid) equilibria. Let the 
set of coUinear links be termed the line set Me- By equation ([T]) the three links are linearly 
dependent, and AC is naturally parameterized by two links and the planar 90° rotation matrix J: 



A/'e = {e G Im^/" : e^J 62 = 0} , where J 



1 

-1 



Note that Se and AC are a positive distance apart, which follows directly from Theorem 2. 1 It 
can easily be checked that A^ is invariant with respect to the link dynamics, which implies that 
initially coUinear robots remain coUinear for all time [|7|-[|9| and formation control fails. 

B. Instability of the Line Set 

Our goal is to show that trajectories of the link dynamics are bounded away from the line set 
Me- References ||8|-| 11 1 carry out a Lyapunov approach and show that a function related to the 



point- to- set distance to the line set A^ is locally increasing (near the coUinear equilibria A/'efl We). 
Up to a multiplicative constant the chosen Lyapunov functions are equivalent to the oriented area 
of the triangle, which is l/2ef Je2. Obviously, these Lyapunov functions are problem- specific 
for the triangular formation and do not extend to other examples. By decomposing A^ into 
submanifolds and applying the results of the previous section, an analogous result is provable 
by purely algebraic calculations of equation Q and without guessing a Lyapunov function. 



First, we consider a subset of AC, the set of collocated robots defined by the zero set = 
{e G ImH : e = 0}. Since Xe is the origin of M^, it is an embedded submanifold of located 
in ImH. Its normal space NeX^ can easily be parametrized as 



NeXe = columnspan < 



h 




h 
h h 



where the first four columns are within the link space and the last two are orthogonal to it. We 



now apply Theorem 3.1 to show overflowing invariance of X^^ex^ the tubular ex neighbourhood 



of Xe- Together with Corollary 3.1 this guarantees hyperbolic instability of X^. 

Lemma 4.1: Consider cq G \m.H such that X^ fl fi(y(eo)) 7^ 0. There exists > such that 
for every ex G (0, e^] the set VL{V{eQ)) \ X^^ex invariant. 

Proof: We calculate the matrix Tx^ from equation Q for the invariant set X^. The Jacobian 
of the vector field (|3]) evaluated on Xe is obtained as if diag(— rff I2), and the first four columns 
of N(,X(, provide a basis for the normal space of X^, within the link space. Thus we obtain 

{2dl + Adl)l2 {dl-3dl-dl) I2 
{dl-3dl-dl) I2 {2dl + Adl)l2 
A simple argument shows that the principal minors of Tx^ are positive whenever di, d2, and 
(is satisfy the triangle inequalities. Thus the assumptions of Theorem |3.1| and Corollary |3.1| are 



satisfied within the compact and invariant set ^l{V{eo)), and the lemma follows immediately. 
In order to continue, consider the smooth function F : — )■ M^, 

ei + 62 + 63 

and note that can be written as the zero set = F~^(0). The Jacobian of F(e) is given by 

-e^J ej J 

and has constant rank three for all e G F~^(0) \ {0} and a rank loss for e = 0. Thus AC is 
not a submanifold. However, if we subtract the set Xe together with the negatively invariant set 



Fe(e) 



Xe^ex U dXe^ex^ with ex from Lemma 4.1, then we obtain := Me \ Xe,ex embedded 



submanifold in M^, which follows directly from the parameterization of A^e via F [ 12 Proposition 



5.28]. Note that we have to be cautious in the later application of Theorem 3.1 to M'^ since Ml 
is neither open nor closed in the topology of M^. Note also that M'^ is located in the link space, 
it is invariant, due to hyperbolic instability of X^^ex^ ^^id its normal space is parametrized by 
ImFe(e)|^^ and is well defined. Similar to N(,X(, above, the normal space N^Nl can be split 
into components orthogonal and parallel to (I2,l2,h), the normal vector of the link space. We 



refer to page 140 of the thesis p6| for the easy calculations leading to the parameterization 

-J es h 



NeMl = columnspan < 



-J ei h 
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The following lemma shows that no trajectory can approach the coUinear equilibria via A/'g^^, . 
Lemma 4.2: Consider cq G hnH such that fl We 7^ 0. There exists an e^, > 0, such that 
for every ej^/i E (0, e^,] the tubular e^/ neighbourhood -^'e^ej^, overflowing invariant in We- 
Before we continue to the proof of Lemma 4.2 we state the following algebraic relationship: 
Lemma 4.3: |8| Lemma 6] For any e G A/'e H Wg we have that ipi + ip2 + ''Ps < 0. 



Lemma 4.3 can be proved by considering all possible cases of coUinear and collocated robots. 



With this algebraic relationship we can now move on to the proof of Lemma 4.2 



Proof of Lemma 4.2- First, we verify that M'^ fl Wg is closed. From Lemma 4.1 we know 
that Xe is hyperbolically unstable and that on A'g g^ U dX^^ex the vector field is pointing outward 
and is thus strictly non-zero. In short, X^. is an isolated subset of the coUinear equilibria ACn We. 
Due to continuity of the vector field, there can be no equilibrium set, such as A/'gfl Wg, arbitrarily 
close to A/'e's boundary AC fl dX^^^^. This proves that A/'e fl We is closed. Compactness follows 
from the fact that We is compact. The Jacobian of the vector field is given by /fdiag(0i) with 
6j := (V'i/2 + Scjcf )|eGAr^nWe- For notational convenience, the argument e G A/'g' fl Wg is left out 
in the following calculations. A basis for the normal space of A/'g within the link space is given 
by the first column of NeN'^. Following an easy calculation we obtain term from Q as 

r_v'^(e) = e^J9iJe2 — 63 ^62^63 + 6^762^63 — e^JQ^^Jei + ef JGsJei — J9iJe2 . 

The expression J0jJ simplifies further to J6jJ = —iJjil2 + 2Jeief J . Note that for e G A/'g'!"! Wg 
the links are coUinear and thus we have for any k G {1, 2, 3} that 



Therefore, r^^(e) simplifies to 

rA/-^(e) = {e2ipiei + 6^-02 62 + e^tpses) - {tpi \\e2f + \\e3f + tps \\eif) ■ (11) 
Now we evaluate this expression on the compact set A/'gfl We- Remember that for any e G A/'gH We 



it holds that ei ipi = 62 = 63^3. Consequently, the first term of ( [TT] ) is zero: 

62 i)i ei + 63 i)2 62 + ef 63 = (ei + 62 + 63)^ ei V^i = . 

To analyze the second term we consider the cases where two or none of the robots are collocated: 
case 1: e G {A/'^ n We} n {e G \m.H : = 0,ej^i ^ 0, i,j G {1,2,3}}: Suppose robot 1 
and robot 2 are collocated, that is, ei = 0. It follows that ipi = —df < 0, 62 = —63 and also 



= ei ^1 = 62 ^2 = 63 V^3 = —62 ^3 = —63 V^2- Thus we obtain from ( [TT| ) that 
rAri(e) = ||e2f + €^^^263+ 0) = c/2||e2f>o. 
The proof for 62 = and 63 = is analogous. 

case 2: e G {A/'g fl We} n {e G Imi^ : a ^ , i E {1,2,3}}: Suppose all three robots are 
coUinear but none of them are collocated. Then there exists x G M \ {—1, 0} such that 62 = x ei 

and 63 = — ei — 62 = — (1 + x) ei . It follows then with ei ipi = 62^2 = 63 ips that ip2 = ipi/x 



and ^3 = —Tpi/il + x), and from Lemma 4.3 we get the condition ipiXi^x) < 0, where X{x) 



1 + — + After some algebraic manipulations we can reformulate ([TT]) in terms of 
ei, tjji, X, and A(x) as a product of strictly positive terms: 

T^,{e) = 2 lleif ■ (-^1 A-i(x)) ■ {{x + 1/2)2 ^ 3/4)3/(3;2(i + a;)^) > q . 

In summary, r^^(e) > for any e in the compact set M'^ fl Wg. Equivalently, there exists 
e^, > such that for every tj^i G (0, e^,], A/'g^^, is overflowing invariant in Wg. ■ 
From Lemma 4.2 we conclude that the vector field ([3]) is pointing strictly outward on the set 



5e^, := {e G Imi^ : e = e + e^f> ■ n^,e e M^f} Wg, G iVgA/"^, ||ng|| = 1, e^. G (0, e>,]}, 

that is, the set of non-coUinear links which can be reached from the equilibria A/'g fl Wg by going 
e^j-i or less normally to A^'. After the simple but tedious algebraic calculations in the proofs of 



Lemma 4.1 and Lemma 4.2 we are now in a position to state our final result: 

Theorem 4.1: Consider cq G ImH such that A/'g fl i7(y(eo)) 7^ 0. There exists an e* > 0, such 
that for every e G (0, e*] the set n{V{eo)) \ {A/'g U 5^ U Afg^g} is invariant. 



Proof: Let e* = min{e^,e^,} and let e G (0, e*] be fixed. By Theorem 2.1 for any initial 
condition cq the corresponding trajectory eo) is bounded in i7(F(eo)) and will converge to a 
limit set in We = £^eU{A/'en We}. Assume that trajectories starting off Me approach the coUinear 
equilibria Me H Wg. These trajectories cannot first converge to Me \ We (in finite time) and then 
approach Me H We since then trajectories would intersect the invariant set Me in non-equilibria. 



Furthermore, according to Lemma 4.2, a trajectory starting off MeUS^ cannot approach M^HWe 



via a neighbourhood of M^ because it cannot enter S^. By Lemma 4.1[ the set Q(y{eo)) \ A?e,e 
is invariant, too. Therefore, a trajectory ^{t,^o) with ^ ^(^(eo)) \ {A^ U 5^ U A?e,e} cannot 
approach {Me \ We} U {M^ fl We} U A^e = AC. In particular, ^o) will be bounded away from 
U iSe U A?e,e- Finally note that e can be chosen arbitrarily in (0, e*]. ■ 



Theorem 4.1 implies that initially not coUinear robots will never be coUinear and the corre- 
sponding trajectory will be bounded a strictly positive distance away from the coUinear equilibria. 
By standard arguments [[8|-[10|, p6| , it can now be shown that a trajectory starting off Me 



enters the level set f2(p) from Theorem 2.1 within a finite time. Thus the target formation £e 
is exponentially stable with ImH \ Me as exact region of attraction. Spoken differently, initially 
not coUinear robots converge exponentially to the specified triangular formation. 

We conclude by discussing three possible extensions of the presented global stability analysis. 



(i) The final result in Theorem 4.1 can also be proved for more general and non-quadaratic 
potential functions, such as the potential functions defined in Q growing infinitely as two robots 
approach each other. Invariance of Im^ \ Xe follows by standard Lyapunov arguments. Lemma 
4.3| still holds [[9j Lemma 5], and thus Lemma 4.2 and Theorem 4]T]can be proven analogously. 



(ii) Switching topologies can be considered that are infinitesimally rigid, for example a cyclic 
topology with reverse link orientations, an undirected or acyclic topology. For each of these 
topologies local stability of Se is guaranteed by Theorem 2]T](as shown in Q) with the exception 
of the acyclic topology which has to be analyzed based on its cascade structure [|5|, [10|. Note 
that for each topology the same invariant set Me arises and the manifold parameterizations are 
as before. However, for acyclic and undirected graphs the vector fields (and their Jacobians) are 
different and the positive definiteness of (|7]) has to be verified separately for the two topologies. 

(iii) Higher order minimally rigid formations with undirected graphs have as limit sets also 
either the target formation £e or non-rigid formations We\£e [|6|, which typically have coUinear 
hnks. Therefore, the invariant sets are similar and can be analyzed with the methods presented. 



V. Conclusion 



The present paper considers a global stability analysis of the formation problem for au- 
tonomous robots. Based on the notion of overflowing invariance and geometric arguments a 
condition is derived in order to show instability of embedded submanifolds. This geometric 
method is then successfully applied to the example of a triangular formation with cycUc sensor 
graph in order to rule out undesired non-rigid limit sets of the closed-loop dynamics. The result 
relies on purely algebraic calculations and not on guessing a problem-specific Lyapunov function. 
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